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ANALYSIS  OF  PROTOTYPING 
ABSTRACT 


This  report  analyzes  current  self-contained  DBMS  simulation  and  prototyping  tool 
products  and  connpares  the  application  development  productivity  increases  gained  to 
those  of  life  cycle  development  efforts  with  third  generation  languages.  The  report 
is  based  on  telephone  interviews  with  users  who  have  been  actively  employing  proto- 
typing in  their  development  efforts. 

Although  no  current  product  in  the  market  satisfies  all  the  prototyping  needs  of  IS 
departments,  all  were  considered  to  be  at  least  satisfactory. 

The  report  also  addresses  future  prototyping  tool  requirements  and  offers  a  sample 
checklist  of  23  features  that  should  be  assessed  when  making  product  comparisons. 

This  report  contains  79  pages,  including  24  exhibits. 
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INTRODUCTION 


PURPOSE 

As  part  of  INPUT'S  Information  Systenn  Program  (ISP),  this  report  analyzes  the 
growing  use  of  applications  simulation  and  prototyping  tools.  This  research 
was  conducted  based  on  client  interest  and  need  to  be  more  productive. 
Systems  development  productivity  is  a  critical  objective  for  most  IS  organiza- 
tions, and  its  achievement  constitutes  a  major  contribution  to  cost  contain- 
ment and  the  organization's  ability  to  reduce  its  applications  backlog. 

SCOPE 

A  selected  group  of  "showcase"  prototyping  development  activities  were 
chosen  to  focus  on  advanced  prototyping  approaches  in  use.  Through  this 
approach  the  most  valuable  lessons  are  documented  and  can  be  used  to 
improve  clients'  application  development  processes. 

This  report  highlights  the  most  productive  prototyping  efforts  in  use  as  judged 
by  the  vendors  sampled.  Each  vendor  was  asked  to  recommend  its  best 
customers  for  INPUT  to  interview.  The  report  focuses  on  a  mature  user  cross 
section  that  has  been  using  simulating  and  prototyping  tools  to  constrain  costs 
and  reduce  applications  backlogs.  The  following  IS  management  personnel  will 
find  the  report  valuable: 


-  I  - 

©1985  by  INPUT.  Reproduction  Prohibited. 


INPUT 


Directors, 

Systems  development  personnel. 

Programming  personnel. 

Client  (user)  liaisons. 

Information  center  personnel. 

This  report  addresses  the  following  questions: 

How  are  the  respondents  using  prototyping  tools  to  develop 
applications? 

How  are  simulation  and  prototyping  defined?  What  product  features 
are  necessary? 

Where  have  the  respondents  used  prototyping  and  on  what  kinds  of 
systems  development  projects? 

When  in  the  project  development  life  cycle  is  prototyping  being 
applied? 

Why  has  prototyping  been  beneficial  and  what  are  its  weaknesses? 
METHODOLOGY 

Thirteen  vendors  were  asked  to  supply  customers  who  they  thought  were  using 
their  product  extensively  to  simulate  business  requirements  and  prototype 
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applications.  Exhibit  I- 1  contains  a  connplete  list  of  products  used  by 
respondents. 

•  Primary  research  for  this  report  was  based  on  user  and  vendor  responses  to  he 
questionnaire  found  in  Appendix  B.  Users  responded  to  all  questions  while 
vendors  completed  numbers  26-^7  of  the  questionnaire  based  on  the  features 
their  products  provided.  Questionnaire  probes  were  designed  to  determine  the 
full  use  of  advertised  vendor  features  and  productivity  claims.  The  research 
reflects  the  progress  made  in  the  last  10  years  and  compares  third  generation 
language  (3GL)  system  development  productivity  results  to  fourth  generation 
languages  (4GL)  in  use  today. 

D.       RELATED  INPUT  REPORTS 

•  Fourth-Generation  Languages  Update:  Potential  Unrealized  (1985)  investi- 
gates whether  the  potential  of  FGLs  is  being  realized.  Mainframe-,  mini-,  and 
micro-based  products  are  analyzed  as  well  as  IS  versus  end-user  applications. 
Actual  benefits  are  described  and  analyses  of  successes  and  failures  of  FGL 
applications  made.  The  report  concludes  with  a  forecast  of  future  FGL 
products  and  an  analysis  of  how  FGLs  will  fit  in  with  forthcoming  artificial 
intelligence  products. 

•  Artificial  intelligence  (Al)  and  Expert  Systems  (1985)  predicts  the  breakout  of 
these  tools  from  academia  to  business.  The  report  analyzes  the  strengths  and 
weaknesses  of  these  systems.  The  strategic  potential  of  Al  and  expert 
systems  as  a  competitive  weapon  is  examined.  The  report  also  describes  the 
technological,  personnel,  and  organizational  requirements  for  these  systems  to 
become  useful  and  beneficial. 

•  Application  Software  Development  Tools  (1985)  analyzes  software  produc- 
tivity   tools,    including    resource    centers,    applications    generators,  and 
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EXHIBIT  1-1 
PROTOTYPE  TOOLS  REPORTED  IN  USE 


TOOL 

VENDOR 

*Corvet 

Analysts  International  Corp. 

Proxy 

Data  General  Corp. 

1-2-3 

Lotus  Development  Corp. 

*Express  E3000 

Information  Resources,  Inc. 

*System  38  Utilities 

International  Business  Machines 

Corp. 

dBase  ill  Command  Language 

Ashton-Tate,  Inc. 

*IFPS  PC  &  Mainframe 

Execucom  Systems  Corp. 

FOCUS,  Developed  In-House 

Automobile  Manufacturer 

*MANTIS 

Cincom  Systems,  Inc. 

*FOCUS 

Information  Builders,  Inc. 

COBOL 

International  Business  Machines  Corp. 

*Mark  V 

Informatics  General  Corp. 

*UFO 

Martin  Marietta  Data  Systems 

CICS  Command  Level 

International  Business  Machines 

Corp. 

*APPGEN 

Software  Express,  Inc. 

*System 

Comshare,  Inc. 

*FCS 

THORN-EMI  Computer  Software 

Inc. 

*Natural 

Software  AG  of  North  America, 

Inc. 

*ADS/ON-LINE 

Cullinet  Software,  Inc. 

DLM 

Cullinet  Software,  Inc. 

Easytrieve  Plus 

Pansophic  Systems,  Inc. 

^  *  Vendor  prototype  products  (13)  used  as  the  sample  basis  for  this  report.  The  remaining  tools  were  also  used  by 

the  respondents  for  prototyping. 
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programmers'  tool  kits.  Products  are  analyzed  and  actual  benefits  described. 
The  report  recommends  techniques  for  improving  software  development 
productivity  and  discusses  the  roles  products,  training,  and  organization  will 
have  in  improving  productivity. 

Decision  Support  Evolution;  Data  to  Knowledge  (1985)  investigates  the 
purpose  of  decision  support  systems.  It  analyzes  the  evolution  of  decision 
support  from  management  information  through  expert  systems,  including 
defining  where  decision  support  stops  and  decision  making  begins.  The  report 
addresses  the  limitations  of  decision  support  systems  and  identifies  justifica- 
tion techniques  for  these  systems. 

New  Opportunities  for  Software  Productivity  Improvements  (1985)  suggests 
that  the  conditions  may  now  be  right  for  some  major  improvements  and 
investigates  the  importance  of  management  commitment  to  improving 
productivity  and  to  investment  in  new  development  systems. 
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EXECUTIVE  SUMMARY 


This  Executive  Summary  is  given  in  presentation  format  to  help  the  busy 
reader  quickly  review  key  research  findings. 

It  provides  an  executive  presentation,  complete  with  script,  to  facilitate 
group  communications. 

The  key  points  of  this  entire  report  are  summarized  in  Exhibits  11- i 
through  11-5. 

On  the  left-hand  page  facing  each  exhibit  is  a  script  explaining  that 
exhibit's  content. 
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A.       USER  PRODUCTIVITY  IMPROVEMENTS 


Productivity  improvements  are  very  significant  when  compared  to  respon- 
dents' 3GL  experience. 

Leading  the  list  of  productivity  gains  was  the  ability  to  build  the  first  proto- 
type faster.  One  respondent  commented,  "Users  love  it~they  can  see  some- 
thing every  two  weeks  on  a  terminal  instead  of  every  two  years." 

Major  productivity  gains  were  reported  in  most  critical  applications  develop- 
ment areas. 

Productivity  gains  display  increasing  percentage  improvements  over  3GL 
approaches  as  follows: 

A  200-300%  improvement  range  was  reported  in  the  time  it  takes  to 
build  the  first  application  prototype  along  with  a  reduction  in  both  the 
number  of  program  statements  and  the  development  time  devoted  to 
programming  mechanics,  such  as  compilations. 

A  100-150%  improvement  range  resulted  from  enhanced  program  code 
quality  and  a  reduction  in  training  time. 

A  50-100%  range  in  time  savings  was  due  to  automatic  code  generation 
and  data  editing.  Reduced  development  effort  achieved  by  sharing 
program  modules  which  were  common  to  the  system  represented  the 
minimum  savings  of  62%. 

The  sample  user  prototyping  productivity  improvements  results  are  character- 
istic of  a  classic  productivity  function  ("5"  shaped)  with  the  highest  gain 
resulting  in  the  time  it  takes  to  build  the  first  prototype.  Exhibit  II- 1 
documents  the  prototyping  productivity  function. 
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EXHIBIT  11-1 
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B.       ORGANIZATIONAL  IMPACT 


•  Users  forecast  a  21%  increase  in  the  use  of  prototyping  efforts  for  each  of  the 
next  three  years.  This  increment  is  nearly  double  the  expected  IS  budget 
growth. 

•  Respondents  have  been  applying  prototyping  for  an  average  of  3.6  years  and 
are  very  positive  about  its  value.  They  will  continue  to  use  it  in  the  future  to 
reduce  the  applications  backlog. 

•  Prototyping  has  been  used  in  a  broad  range  of  applications,  from  producing 
simple  reports  (77%)  to  developing  large  integrated  applications  (100%). 

•  All  respondents  have  applied  prototyping  in  small  and  large  single  application 
systems  development  projects. 

•  Prototyping  is  currently  being  used  for  development  projects  ranging  from 
simple  reports  to  large  integrated  applications.  However,  as  Exhibit  11-2 
demonstrates,  the  proportion  of  applicotions  being  prototyped  diminishes  in 
the  case  of  integrated  applications. 
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ORGANIZATIONAL  IMPACT 


Degree  of  Complexity 

5.  Large  Integrated  Applications 
4.  Small  Integrated  Applications 


3.  Large  Single  Applications 
2.  Small  Single  Applications 
1.  Simple  Reports 


Proportion  of  Respondents'  Use  of  Prototyping 
by  Degree  of  Complexity 
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C       LIFE  CYCLE  IMPACT 


•  Respondents  reported  a  collapsing  of  the  life  cycle  development  process. 
Several  respondents  indicated  that  the  innplementation  phase  was  nonexistent 
or  part  of  the  development  phase.  The  new  approaches  are  changing  the  shape 
of  the  old  life  cycle  time  distribution  curve. 

•  On  average,  respondents  indicated  that  they  were  experiencing  a  212% 
improvement  over  third  generation  language  development  approaches. 

•  Most  of  the  productivity  gains  came  from  the  design  (217%)  and  development 
(243%)  phases. 

•  Better  quality  systems  are  the  result  of  user  prototyping  efforts  as  evidenced 
by  the  ease  of  making  maintenance  and  updates.  This  value  improved  by 
118%.  Since  maintenance  often  contributes  the  majority  of  the  life  cycle 
costs,  this  is  potentially  very  significant. 

•  Exhibit  11-3  represents  a  conceptual  model  that  describes  the  distribution  of 
project  time  for  3GL  (old)  and  4GL  (new).  The  major  difference  is  the 
reversal  of  the  proportion  of  total  project  time  from  phases  3  and  4  for  3GL 
to  I  and  2  for  4GL,  again  implying  lower  overall  life  cycle  costs.  However, 
the  data  does  not  cover  the  actual  results  of  an  application  in  full  production 
which  may  change  these  initial  results. 
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EXHIBIT  11-3 
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D.       USERS'  VENDOR  PRODUCT  RATINGS 


•  Most  (92%)  users  rated  their  tools  to  be  at  least  satisfactory  for  prototyping. 

®  The  ratings  were  evenly  split  between  ratings  of  4  for  satisfactory  and  5  for 
adequate  (on  a  scale  of  I  being  inadequate  and  5  being  adequate).  There  were 
no  inadequate  ratings  and  only  8%  rated  the  product  average.  An  adequate 
rating  means  the  vendor's  products  provide  enough  facility  to  meet  the 
organization's  existing  prototyping  needs.  An  average  rating  indicated  that 
most  prototyping  tasks  can  be  performed. 

•  The  major  prototyping  features  desired  in  order  of  preference  were: 

Program  Development  Tool  Category. 
DBMS  Support  Tool  Category. 
General  Support  Tool  Category. 

•  Exhibit  11-4  shows  only  the  ratings  for  prototyping,  which  is  one  of  the  major 
strengths  of  4GL  technology. 
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EXHIBIT  11-4 
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USERS'  VENDOR  PRODUCT  RATINGS 
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E.       LS.  OPPORTUNITIES/FUTURES 


•  In  a  word,  the  respondents  were  "upbeat,"  Their  prototyping  tools  have 
allowed  them  to: 

Chip  away  at  the  applications  backlog. 

Improve  user/IS  communications. 

Demonstrate  real  success  projects  for  management. 

•  All  respondents  are  planning  extensive  use  of  prototyping  for  new  projects  and 
through  other  development  plans  based  on  productivity  gains  of  the  past. 

•  Users  are  looking  forward  to  the  next  generation  of  prototyping  tools. 
Flexibility,  enhanced  product  speed/capabilities,  plus  an  integrated  applica- 
tions systems  requirements  definition  capability  are  their  expectations  in  the 
next  three  years. 

•  Exhibit  11-5  summarizes  the  respondents'  major  plans  for  prototyping. 
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INFORMATION  SYSTEMS  PROTOTYPING 
OPPORTUNITIES/FUTURES 

•  Use  Prototyping  for  New  Applications 

•  Most  Will  Use  for  More  Complicated  Projects 

•  Vendors  Need  to  Enhance  Their  Existing 
Products 

•  There  Is  a  Need  for  Improved  Vendor  Products 
to  Keep  Pace  with  Demand 
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POPULAR  INDUSTRY  PROTOTYPE  TOOLS 
BACKGROUND  AND  DEFINITIONS 


•  Prototyping  as  an  alternative  to  the  traditional  life  cycle  approach  to  systems 
developnnent  has  been  known  for  a  number  of  years.  D.  Ness,  of  the  Wharton 
School,  recommended  a  design  approach  he  called  "middle  out"  in  1975.  Other 
references  to  early  forms  of  prototyping  such  as  adaptive  design  and  evolu- 
tionary design  are  10  years  old  or  older.  Here  we  will  gauge  how  far  we  have 
come  in  the  past  decade. 

•  Simulation  refers  to  the  process  of  reducing  a  business  requirement  to  a  set  of 
function  requirements.  Prototyping  is  the  translation  of  the  simulated 
business  requirement  into  an  IS  application  specification.  We  will  refer  to 
these  dual  terms  throughout  this  report  as  prototyping— simulation  is  always 
assumed. 

•  Exhibit  lli-l  represents  a  working  prototype  definition  which  was  validated  by 
the  research  respondents.  The  five  elements  are  presented  in  rank  order 
priority  from  I  to  5,  based  on  a  scale  of  I  being  unimportant  and  5  being  a 
very  important  part  of  the  respondent's  prototyping  methodology. 

•  The  respondents'  ratings  were  consistently  high  and  averaged  4.0  (important). 
Additional  comments  were: 


-  19- 


©1985  by  INPUT.  Reproduction  Prohibited. 


INPUT 


EXHIBIT  111 
WORKING  PROTOTYPE 


-1 

DEFINITION 


RANK 
ORDER 

DEFINITION 
ELEMENT 

RESPONDENTS 
AVERAGE 
RATING 

First 

An  iterative  learning  process  is  a  given  for  the  design 
phase  of  a  system's  development.  A  model  (prototype)  is 
built  for  user  evaluation  and  is  returned  to  the  analyst 
for  updating.  This  is  understood  as  a  heuristic  (learning) 
process  for  both  the  system  builder  and  the  user. 

4.5 

Second 

To  ensure  the  convergence  of  user  requirements  and  IS 
ability  to  satisfy  these  needs,  users  must  actively 
participate  in  the  design  through  the  implementation 
phase. 

4.2 

Third 

Prototype  development  depends  on  relatively  fast  turn- 
around or  minimum  time  between  iterations.  Timely 
feedback  is  a  prerequisite  for  effective  user  and 
analyst  learning. 

4.0 

Fourth 

Integrated  hardware  and  software  development  tools  are 

4.0 

Fifth 

The  initial  prototype  must  be  produced  at  minimum  cost. 
Minimum  cost  can  be  difined  either  as  a  function  of  a 
corporate  capital  justification  policy  or  based  on  the 
organization's  past  experience.  The  latter  unit  of 
measure  is  probably  the  more  realistic  of  the  two,  since 
it  requires  productivity  improvement  and  can  be 
measured  over  time. 

3.3 
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"Our  major  concern  is  to  reduce  the  number  of  iterations;  we  want 
better  communications  between  users  and  developers," 

"Ease  of  use," 

One  user  suggested  that  prototyping  provided  "political  support,  high 
level  entry"  for  his  systems  development  efforts. 

B,       PRODUCT  FEATURES  FOR  PROTOTYPiNG 

•  Depending  on  the  level  of  effort  and/or  the  kind  of  application  project  being 
developed,  a  wide  variety  of  tools  are  available.  The  possibilities  run  the 
gamut  from  analysis  packages  like  Lotus  1-2-3  through  application  generators 
such  as  IBM's  ADF.  But  given  the  impact  of  data  base  management  systems 
(DBMS),  this  research  concentrated  on  self-contained  DBMS  languages  and 
DBMS  product  suites  which  are  actually  an  outgrowth  of  DBMS.  The  three 
major  feature  categories  used  to  evaluate  these  products  were  as  follows: 

General  support  features. 

Data  management  support  features. 

Program  development  features. 

•  Through  an  examination  of  existing  products,  24  detailed  features  were 
developed  which  specifically  fit  in  the  3  major  categories  above.  A  list  of 
these  features  and  their  definitions  are  found  in  Appendix  A.  Exhibit  III-2 
presents  the  products  selected  and  vendor-defined  product  features.  Company 
support  data  for  each  of  the  respondent  vendors  is  presented  in  Appendix  C. 
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The  vendor  sample  used  for  this  research  is  estimated  to  be  25-33%  of  the 
total  self-contained  DBMS  products  market  with  an  above  average  proportion 
of  DBMS  product  suites.  This  sample  represents: 

A  total  of  10,120  installed  packages. 

An  average  cost  per  package  of  $74,400~ranging  from  $34,000- 
127,000. 

Average  total  company  sales  of  $82.2  million,  supported  by  a  mean  of 
755  employees. 

Roughly  one-half  of  the  vendor  products  were  introduced  in  the  1972-1979 
time  period  (55%),  the  rest  between  1980-1982  (45%).  They  represent 
relatively  new  product  offerings. 

Many  vendors  have  targeted  their  products  to  be  supported  by  IBM's  large- 
scale  mainframes  (with  the  preponderance  being  4300  series  and  up).  Other 
equipment  vendors  are,  however,  liberally  represented. 

No  sample  vendor  could  boast  of  providing  all  23  of  the  prototyping  features 
listed  in  Exhibit  111-2.  On  average,  the  vendor  sample  claimed  to  meet  74%  of 
the  feature  requirements.  The  distribution  of  features  supplied  by  the  vendors 
that  responded  are  as  follows: 

Thirty-one  percent  supplied  87-96%  of  the  total. 

Thirty-one  percent  supplied  70-78%  of  the  total. 

Thirty-eight  percent  supplied  48-65%  of  the  total. 

This  analysis  suggests  that  the  user  must  have  a  good  specification  for  the 
facilities  he  requires  and  carefully  evaluate  vendor  offerings  based  on  the  kind 
of  facilities  required  to  prototype. 
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C.       SYSTEM  DEVELOPMENT  LIFE  CYCLE  IMPACT 


Respondents  were  asked  to  estinnate  the  percentage  improvement  for  the 
entire  life  cycle  from  design  phase  to  implementation  phase.  On  average, 
they  estimated  that  the  entire  life  cycle  improvement  was  212%.  However,  it 
is  interesting  to  note  that  the  major  improvements  were  found  in  the  first  two 
phases,  217%  for  design  and  243%  for  development. 

Several  respondents  indicated  that  the  implementation  phase  was  nonexistent 
or  was  now  part  of  the  development  phase.  These  marginal  comments  suggest 
a  collapsing  of  the  life  cycle  process.  Given  the  improvements  cited,  it  is  not 
just  a  shift  in  effort—it  is  a  real  reduction  in  the  time  to  deliver  the  system. 
Maintenance  changes  and  updates  also  were  reported  improved  by  1 18%.  This 
would  indicate  a  lasting  productivity  impact  affecting  even  the  maintenance 
of  the  new  system.  - 


D.       ORGANIZATIONAL  IMPACT 


The  average  annual  growth  rate  for  prototyping  activities  was  reported  to  be 
21%  which  is  considerably  greater  than  the  respondents'  total  IS  budget 
growth  rates  of  12%.  These  growth  rates  represent  the  respondents'  projec- 
tions for  the  next  three  years,  indicating  sizable  future  increases. 

Respondents  were  asked  to  define  their  applications  prototyping  experience 
level.  A  series  of  probes  was  presented  which  indicated  increased  complexity 
from  (I  =  simple)  "uses  prototyping  to  develop  single  reports"  to  (5  =  complex) 
"uses  prototyping  to  develop  large  integrated  applications."  These  results,  and 
those  of  a  question  regarding  the  length  of  time  prototyping  had  been  a  formal 
part  of  the  applications  development  process,  substantiate  advanced  proto- 
typing implementation.  On  average,  the  group  has  been  using  prototyping  for 
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3.6  years  and  has  progressed  through  all  five  levels  of  complexity,  as  shown  in 
Exhibit  III-3. 

Experience  was  heavily  concentrated  (100%)  in  the  small  to  large  single 
applications  levels  (2  and  3)  with  substantial  experience  {69%  and  77%  respec- 
tively) in  the  small  and  large  integrated  applications  levels  (4  and  5).  It  should 
be  noted  that  many  respondents  skipped  the  first  project  level  (simple 
projects)  and  went  directly  to  levels  2  through  5.  This  analysis  clearly  shows 
prototyping  is  being  used  in  more  complex  projects. 

USER  PRODUCT  FEATURE  REQUIREMENTS 

Since  this  research  draws  on  user  experience  with  13  prototyping  products,  the 
list  of  features  developed  represents  a  prototyping  "tool  box"  in  current  use. 

Respondents  were  asked  to  rate  the  importance  of  the  tool  features  on  a  scale 
of  1-5  (I  being  unimportant  and  5  being  very  important).  They  were  also 
requested  to  rate,  on  the  same  scale,  the  amount  of  technical  knowledge 
required  to  use  the  features  with  I  being  no  technical  IS  knowledge  required 
to  5  representing  advanced  technical  IS  knowledge  required.  As  might  be 
expected,  the  three  major  categories  (general  support,  DBMS  support,  and 
program  development  support)  were  rated  progressively  more  important. 

Each  of  the  major  categories  described  in  Exhibit  iil-4  are  analyzed  to  isolate 
the  most  important  integrated  hardware/software  development  tool 
features.  Exhibits  III-5  through  III-7  present  both  the  importance  of  the 
feature  and  the  level  of  technical  IS  knowledge  required  to  use  it. 

General  support  features  included  nine  items,  five  of  which  were  rated  above 
the  average  value  of  3.3.  The  features  which  were  regarded  as  of  above 
average  importance  were  security,  operating  system  independence,  audit,  and 
PC/mainframe  link.  Today's  emphasis  on  protecting  corporate  assets  and  the 
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EXHIBIT  111-3 


PROTOTYPING  EXPERIENCE  LEVEL 


PROJECT 
TYPES* 

RESPONDENTS  USE  OF  PROTOTYPING 

1 . 

Simple 
Reports 

1 

2. 

Small  Single 
Applications 

100% 

3. 

Large  Single 
Applications 

100% 

Small 

1 ntegrated 
Applications 

4. 

Large 

1  ntegrated 

Applications 

5. 

1 

1                              1                              1  1 

0  20  40  60  80  100% 


*ln  Order  of  Complexity:  1  =  Simple,   5  =  Complex. 
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EXHIBIT 


PROTOTYPING  SUPPORT  TOOL  CATEGORY  IMPORTANCE 


5.  0 


1.0 


General 
Support 


DBMS 
Support 


Program 
Development 
Support 


■Rating:  1  =  Unimportant,   5  -  Very  Important 
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EXHIBIT  III-5 


GENERAL  SUPPORT  FEATURES 
IMPORTANCE  AND  TECHNICAL  KNOWLEDGE  REQUIRED 
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EXHIBIT  III-6 

DBMS  SUPPORT  FEATURES 
IMPORTANCE  AND  TECHNICAL  KNOWLEDGE  REQUIRED 
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5.  0 


Feature  Importance 
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Technical 
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*Rating:   1  =  Unimportant,   5  =  Very  Important 
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EXHIBIT  II1-7 


PROGRAM  DEVELOPMENT  SUPPORT  FEATURES 
IMPORTANCE  AND  TECHNICAL  KNOWLEDGE  REQUIRED 


*Rating:  1  =  Unimportant,  5  =  Very  Important 
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continued  effort  by  the  accounting  fraternity  to  have  application  auditabiiity 
built  in  from  the  beginning  make  the  security  and  audit  features'  importance 
understandable.  Operating  system  independence  can  be  considered  a  part  of 
most  tools,  and  the  fourth-place  entry  of  the  PC/mainframe  link  shows  the 
importance  of  emerging  systems  development  workstations.  Those  features 
which  were  rated  as  below  average  in  importance  can  be  obtained  outside  the 
product  used  or  as  an  adjunct  to  prototyping.  For  example,  one  respondent 
said  that  he  did  have  an  important  need  for  high  quality  graphics,  but  he  used 
separate  system  resources  to  satisfy  this  requirement.  Exhibit  III-5  details 
the  results  of  these  queries.  Each  feature  is  presented  with  its  associated 
technical  knowledge  requirement  evaluation. 

•  Moving  closer  to  the  immediate  needs  of  the  prototyper,  DBMS  support 
features  of  the  greatest  importance  were  data  language  independence,  data 
dictionary,  and  relational  data  base.  It  should  be  noted  that  no  attempt  was 
made  to  determine  what  level  of  sophistication  the  respondents'  relational 
data  base  support  included.  Most  agreed  that  they  had  relational  data  base 
capabilities.  The  data  dictionary  level  of  technical  knowledge  rates  as  one  of 
the  most  demanding  features.  Using  the  same  metrics  as  explained  above. 
Exhibit  III-6  presents  the  relative  importance  of  the  DBMS  support  features. 

•  Of  all  the  prototyping  features  explored,  program  development  support  tools 
proved  to  be  the  most  important.  Ten  items  were  assessed,  and  60%  of  them 
were  rated  as  "important"  or  approaching  "very  important."  On-line  develop- 
ment led  the  list,  following  five  important  companion  features: 

Screen/report  writer  (4.5). 

Interactive  debugging  (4.5). 

Query/retrieval  (4.5). 

Text  editing/formatting  (4.2). 

Automatic  documentation  (3.9). 
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Batch  processing  and  foreign  application  conversion  are  not  innportant 
features.  The  English  language  query  feature  which  is  touted  to  be  for  end- 
user  development  is  also  not  considered  to  be  of  great  importance,  even 
though  it  is  reported  to  be  easy  to  use.  Exhibit  III-7  summarizes  these  results. 

Based  on  the  respondent  feature  preferences,  integrated  hardware/software 
development  tools  can  be  more  definitively  documented.  The  "tool  box" 
referred  to  at  the  beginning  of  this  section  should  have  the  features  or 
functions  listed  in  Exhibit  111-8. 
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EXHIBIT  III-8 


MAJOR  SOFTWARE  TOOL  FEATURES  DESIRED 


• 

GENERAL  SUPPORT  TOOL  CATEGORY 

-  Security 

-    Operating  System  Independence 

Audit 

-    PC /Mainframe  Link 

• 

DBMS  SUPPORT  TOOL  CATEGORY 

Data /Language  Independence 

-    "Relational"  Data  Base 

-    Data  Dictionary 

• 

PROGRAM  DEVELOPMENT  TOOL  CATEGORY 

-    On-Line  Development 

Screen /Report  Writer 

Interactive  Debugging 

-    Query /Retrieval 

-    Text  Editing/Formatting 

-    Automatic  Documentation 
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IV       USER  PRODUCT  ANALYSIS 


A.  STRENGTHS 


•  Those  surveyed  were  asked  to  moke  a  comparison  between  their  third  genera- 
tion language  (3GL)  experience  and  the  4GL  prototyping  tools  in  use.  Nine 
probes  were  used  to  measure  order  of  magnitude  productivity  improvements 
that  they  experienced.  The  results  (presented  in  descending  order  of 
improvements)  are: 

Shorter  time  to  build  the  first  prototype. 

Reduction  in  the  number  of  programming  statements. 

Program  debugging  time  improvements  related  to  performing 
programming  mechanics  such  as  compilations,  opens,  etc. 

Better  reliability  and  readability  of  application  code. 

Improvement  in  program  modifications  due  to  fewer  syntax  errors. 

Reduction  in  the  training  time  to  be  productive. 

Design  improvement  due  to  automatic  code  generation;  e.g.,  data 
definitions,  screen  formatting,  processing  logic,  etc. 
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Production  systems  improvement  due  to  use  of  automated  data  editing 
features. 

Increased  ability  to  share  program  modules  among  applications. 

While  the  range  of  experience  was  broad,  the  individual  results  tended  to 
cluster  about  the  average.  In  fact,  given  the  diversity  of  the  respondents' 
commercial  interests,  the  average  values  presented  in  Exhibit  IV- 1  reflect 
favorably  on  increased  productivity  resulting  from  the  use  of  these  proto- 
typing tools. 

Percentage  improvement  ranged  from  a  low  of  62%  to  a  high  of  283%.  The 
respondents'  marginal  comments  are  interesting  and  expand  upon  the 
statistical  results.  While  it  was  evident  that  those  questioned  have  realized 
substantial  productivity  gains,  they  made  the  following  comments. 

"Not  easy  to  make  syntax  errors." 

"Almost  impossible  to  make  syntax  errors,  big  reduction  over  3GL." 
"Final  amount  of  code  reduced." 

"First  prototype  done  in  3  days  versus  20  days  with  our  3GL." 
WEAKNESSES 

Since  prototyping  is  understood  to  be  an  iterative  process,  where  the  user  and 
developer  are  moving  jointly  toward  a  final  applications  system,  most 
weaknesses  are  seen  as  deficiencies.  However,  users  do  feel  that  a  high 
degree  of  technical  knowledge  is  required  and  that  future  products  (fifth 


-36- 

©1985  by  INPUT.  Reproduction  Prohibited. 


INPUT 


EXHIBIT  IV-1 


USER  PRODUCTIVITY  IMPROVEMENTS 


Build  First  Prototype  Faster 


Reduced  Number  of  Program 
Statements 


Time  Savings  in  Performing 
Programming  Mechanics 


Improved  Code  Readability/ 
Reliability 


Reduced  Modifications  Due 
to  Syntax  Errors 


Reduced  Training  Time 


Time  Savings  through 
Automatic  Code  Generation 


Time  Savings  Due  to 
Automatic  Data  Editing 


Improved  Program 
Development  by  Sharing 
Program  Modules 


100 


150 


200 


250  300% 


Average  Productivity  Improvements 
( Percent) 
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generation  languages)  should  be  less  technical.  Comments  regarding  future 
products,  specifically  referred  to  as  5GLs,  indicate  a  maturing  of  the  present 
methodology.  Perhaps  the  fact  multiple  respondents  referred  to  their  existing 
tools  as  a  methodology  and  not  as  a  technology  as  the  question  was  framed 
indicates  that  much  of  what  is  now  done  manually  or  based  on  product 
experience  shoud  be  internal  to  5GLs. 

This  suggest  that  new  products  should  be  designed  with  an  expert  system 
approach.  The  technical  skills  required  to  use  today's  4GLs  could  be 
automated  to  allow  the  developer  to  spend  more  time  concentrating  on 
productivity  and  not  language  mechanics.  This  thesis  was  succinctly  put  by 
one  respondent  as  follows:  "We  have  a  300%  productivity  increase,  all  tools 
peak  out.  We  are  at  the  peak,  satisfied  now,  but  will  have  to  go  to  a 
5GL.  .  .cannot  wear  well  forever." 

An  extensive  learning  curve  was  noted  by  several  users,  and  others  indicated 
no  training  productivity  improvement  over  3GLs.  After  all,  these  are  new 
languages  and  take  time  to  learn.  Existing  products  are  inflexible  and  have 
definite  restrictions  related  primarily  to  the  user  not  knowing  the  internal 
working  structure  of  the  tools.  Additional  training  beyond  the  introductory 
courses  would  address  this  weakness.  Excessive  system  resource  usage, 
especially  when  large  amounts  of  data  are  involved,  presents  some  design 
problems.  This  requires  tradeoffs  between  adaptability,  speed,  and  produc- 
tivity requirements. 

A  major  capability  which  none  of  the  surveyed  products  address  is  an  auto- 
mation/integration of  requirements  definition  specification.  This  deficiency 
is  demonstrated  by  comments  regarding  the  amount  of  technical  knowledge 
needed  and  the  requirement  for  "programmers  to  have  in-depth  knowledge  of 
the  application  being  built."  Having  an  integrated  requirements  definition 
specification  module  would  add  an  additional  degree  of  freedom  to  the 
detailed  design  phase.  For  example,  screens/reports,  logical  data  base,  and 
files  specifications  could  be  prespecified  and  validated  by  users  before  the 
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detailed  designing  phase.  This  would  allow  progrannmers  to  concentrate  on 
efficient  code  generation. 

•  Other  comments  which  fall  into  the  "wish  list"  category  were: 

Better/high  speed  tools. 
Windowing  and  split  screen  capabilities, 
improved  multi-session  facilities. 
Reduction  in  unpredictable  errors. 
Offering  true  report  screen  painting. 
Improved  documentation  capability. 

•  Overall,  the  weaknesses  do  not  represent  a  condemnation  of  the  products.  On 
the  contrary,  users  are  in  general  satisfied,  but  vendors  would  do  well  to 
document  and  incorporate  their  suggestions  when  designing  follow-up 
products.  In  fact,  the  average  weakness  rating  was  3.6  on  a  scale  of  1-5, 
where  I  was  minor  and  5  major.  User  responses  were  grouped  into  three 
areas:  methodology  deficiencies  (e.g.,  more  participation  by  users);  product 
enhancements/new  capabilities  (e.g.,  reduce  technical  skill  required,  automate 
requirements  definition  phase),  and  product  deficiencies  (e.g.,  improve 
documentation).  The  results  of  this  analysis  are  presented  in  Exhibit  IV-2. 

C,       LS.  OPPORTUNiTIES/FUTURE 

•  Prototyping  has  provided  a  means  to  chip  away  at  the  applications  backlog  and 
improve  user  communications  andj  in  several  cases,  has  demonstrated  real 
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EXHIBIT  IV-2 


PROTOTYPING  WEAKNESSES 
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Product 
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New  Capabilities 


Product 
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*Rating:   1  =  Unimportant,   5  =  Very  Important 
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success  stories  for  upper  management.  Perhaps  the  strongest  endorsement  for 
the  value  of  this  approach  is  seen  in  Exhibit  iV-3.  A  series  of  questions  sought 
to  measure  the  respondents'  propensity  for  continued  use  of  prototyping  tools 
for  developing  new  and  more  complicated  applications. 

New  applications  will  be  attempted  using  prototyping  for  a  broad  range  of 
reasons,  including  increased  productivity,  new  department  computing 
requirements,  and  the  continued  movement  to  on-line  system  development. 
The  improved  dialogue  between  end  users  and  programmers  also  has  contrib- 
uted to  the  success  of  prototyping.  Prototyping  has  given  these  developers 
new  courage  to  address  the  outstanding  development  requirements  of  their 
organizations.  The  following  are  representative  comments  from  prototyping 
supporters. 

"We  use  it  everywhere." 

"Whatever  comes  down  the  road." 

"Its  value  is  to  improve  communications  from  inception  to  implementa- 
tion." 

"Users  love  it~they  can  see  something  every  two  weeks  on  a  terminal 
instead  of  every  two  years." 

More  complicated  projects  were  not  in  every  respondent's  plans.  One 
answered  this  question  in  the  positive,  but  said,  "if  it  gets  anymore  compli- 
cated, I'm  going  to  quit!"  Responses  that  were  more  typical  were  related  to 
the  use  of  prototyping  to  stay  abreast  of  the  applications  backlog,  to  reduce 
the  timeframe  to  get  projects  going,  and  simply  "because  it  is  better."  The 
developers'  ability  to  build  on  past  successes  and  the  increased  applications 
development  demand  bodes  well  for  increased  use  of  prototyping  for  even 
more  challenging  projects. 
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EXHIBIT  lV-3 
I.S.  OPPORTUNITIES/FUTURE 
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•  Having  tasted  success,  developers  expect  vendors  to  keep  pace.  They  are 
satisfied  with  the  current  vendor  support  and  improved  versions,  but  hope  that 
improvements  will  continue.  Specifically,  they  are  looking  for  fifth  genera- 
tion languages  to  include: 

Improved  ability  to  keep  prototyping  documentation  versions  in  sync 
with  the  code. 

A  link  between  the  requirements  definition  and  detailed  design  phases. 

Data  base  design  tuned  to  flexible  applications  development  proto- 
typing; e.g.,  data  modeling  at  the  logical  architectural  level. 

Improved  features  like  windowing,  split  screens,  multi-session  capabili- 
ties. 

improved  vendor  response  time  for  enhancements  that  incorporate  user 
suggested  improvements. 

Fifth  generation  language  availability  within  the  next  three  years. 
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FUTURE  PROTOTYPING  TOOL  REQUIREMENTS 
PROTOTYPING  DEVELOPMENT  ARCHITECTURE 


•  This  final  section  presents  a  look  at  future  prototype  technology.  It  is  a 
three-year  technology  extrapolation  based  on  the  needs  of  the  respondents, 
documented  product  deficiencies,  and  existing  vendor  products.  For  proto- 
typing to  mature  into  a  technology  from  its  present  methodology  status, 
vendors  and  users  alike  need  to  consolidate  their  collective  experience.  User 
experience  to  date  should  be  tapped  to  begin  developing  the  next  generation 
of  tools  which  we  will  call  fifth  generation  prototyping  languages  (5GPL). 
This  term  was  mentioned  many  times  by  users,  so  it  has  a  research  basis. 

•  The  prototype  development  architecture  presented  includes  the  most 
important  capabilities  documented  by  this  research,  plus  those  capabilities 
which  will  make  protoyping  easier  to  use,  more  flexible,  and  able  to 
contribute  to  improved  productivity  in  the  area  of  systems  development. 
Exhibit  V-l  outlines  the  three  improved  subsets  of  existing  product  offerings 
which  are  required  to  meet  5GL  prototyping  requirements.  Each  of  these 
future  product  subsets  are  further  detailed  in  this  section.  Exhibit  V-l  also 
defines  the  most  important  additional  capabilities  required  for  the  operating 
(general)  system,  DBMS,  and  a  major  new  set  of  capabilities  called  the  system 
development  support  subset.  ' 
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EXHIBIT  V-1 


FIFTH  GENERATION  PROTOTYPING  LANGUAGE  ARCHITECTURE 
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B.       GENERAL  SUPPORT  TOOLS 


•  Links  or  interfaces  to  the  operating  system  need  to  be  developed  to  ensure 
data  integrity,  information  resource  security,  application  auditability,  and 
personnel  computer  (PC)/mainframe  (MF)  connectivity.  The  PC/MF  link  will 
satisfy  the  need  for  prototyping  workstations.  Data  and  resource  security  is 
required  to  prevent  unauthorized  data  access  and  unintentional  damage  or 
removal  of  corporate  information  resources.  Either  existing  standard  security 
packages  or  integrated  protection  software  are  required.  Standard  audit 
routines  are  necessary  to  allow  automated  audit  functions  and  must  be  part  of 
the  initial  design  of  the  applications  system  during  the  prototyping  phase. 
Exhibit  V-2  details  these  features. 

C.       DBMS  SUPPORT  TOOLS 

•  An  integrated  DBMS,  using  the  most  powerful  attributes  of  the  evolving 
relational  model,  needs  to  be  developed  to  include  networking  and  data 
dictionary  capabilities. 

•  Production,  special  (e.g.,  departmental  systems,  etc.),  test,  and  prototype 
applications  require  separate,  partitioned  modules  as  shown  in  Exhibit  V-3. 
These  would  offer  more  powerful  prototyping  capabilities  for  the  flexible 
development  and  migration  of  applications  from  prototype  to  production 
status.  Facilities  such  as  data  manipulation,  data  base  access,  data  definition, 
update,  and  storage  would  be  enhanced. 
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EXHIBIT  V-2 


GENERAL  SUPPORT  TOOLS  SUBSET 
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EXHIBIT  V-3 


DBMS  SUPPORT  TOOLS  SUBSET 
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D.       SYSTEMS  DEVELOPMENT  SUPPORT  TOOLS 


•  A  major  effort  is  required  to  integrate  existing  and  future  systems  develop- 
ment capability  into  today's  4GLs  with  special  emphasis  on  automating  the 
systems  requirement  phase  of  development.  There  are  several  automated 
tools  now  being  marketed  which  represent  various  parochial  approaches  to 
systems  definition,  such  as: 

Excellerator,  Index  Technology  Corporation. 

Information  Planner,  Database  Design,  Inc. 

Structures,  Ken  Orrand  Associates,  etc. 

•  Vendors  may  either  opt  for  a  strategic  alliance  with  the  most  suitable 
products  or  build  gateways  to  these  products.  Requirements  definition  is 
perhaps  the  least  automated  and  the  most  cost  critical  function  in  the 
applications  development  process. 

•  Defining  user  requirements  and  translating  them  into  a  programmable  specifi- 
cation requires  an  automated  mechanism.  The  deliverables  to  meet  these 
requirements  should  include: 

Data  inputs/outputs. 

System,  system  modules,  program  modules,  and  program  specification. 
Logical  data  base  definition  to  the  record,  segment,  and  field  levels. 

•  Exhibit  V-4  presents  a  view  of  the  structure  of  these  requirements.  The  three 
major  modules  required  to  support  the  emerging  developer  workstation 
requirements  are  program,  applications,  and  project  management  capabilities. 
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EXHIBIT  V-4 


SYSTEMS  DEVELOPMENT  SUPPORT  TOOLS  SUBSET 
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The  program  development  module  is  well  established  in  many  of  today's 
products.  In  fact,  most  of  the  productivity  improvements  cited  in  this  report 
have  been  generated  by  these  facilities.  Integrating  this  module  with  the 
applications  development  and  project  management  modules  would  close  the 
loop  and  provide  a  full  set  of  tools  which  are  targeted  to  the  most  cost- 
intense  activities  in  applications  development. 

The  applications  development  module  would  require  a  vehicle  to  translate  user 
requirements  from  simulated  business  functions  into  preprogram  definitions. 
This  capability  would  allow  for  a  definition  of  the  application  at  the  major 
system,  subsystems,  and  program  module  levels.  From  this  level  of  prototype 
detail,  logical  data  elements  and  a  data  base  specification  can  be  developed. 
Data  modeling  and  system  resource  sizing  can  then  be  prototyped  and 
validated  with  the  user.  Detailed  program  specification  and  validation  would 
follow  this  step,  and  prototyping  would  be  improved  to  include  a  solid  user 
requirements  foundation. 

Project  management  tasks  can  be  developed  in  the  project  management 
module  to  include  time/cost  and  system  (hardware/software)  resource 
requirements  estimates  for  project  justification  and  tracking.  Several  respon- 
dents indicated  that  project  on-time/on-cost  performance  still  needs 
improvement.  This  link  between  user  requirements,  project  resources,  and 
project  scheduling  demand  and  project  scheduling,  tracking,  and  reporting 
would  close  the  "applications  development  loop"  and  allow  for  improved 
performance. 

In  summary,  a  5GL  that  addressed  the  above  requirements  would  satisfy  the 
needs  documented  by  the  respondents  and  provide  the  basis  for  improved 
productivity  throughout  the  entire  applications  development  life  cycle. 
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VI       CONCLUSIONS  AND  RECOMMENDATIONS 


A.       CHOOSING  A  PROTOTYPING  TOOL 

•  The  selection  of  a  prototyping  tool  should  be  based  on  a  comprehensive  plan 
for  its  use.  This  plan  should  include  the  following  considerations: 

Personnel  training. 

Integration  with  existing  DBMS. 

Pilot  project  selection. 

Hardware,  software,  operating  system  compatibility. 

•  After  developing  a  plan  for  use  within  the  IS  organization,  a  qualitative 
evaluation  of  vendor  prototyping  products  should  be  performed.  Exhibit  VI- 1 
provides  a  working  checklist  based  on  the  23  features  developed  by  this 
research.  The  12  features  which  were  found  to  be  most  important  by  the 
respondents  are  marked  with  an  asterisk.  Using  this  checklist,  plus  the  defini- 
tions presented  in  Appendix  A,  will  provide  a  basis  for  product  comparisons. 

•  The  final  product  selection  should  be  made  based  on  a  thorough  business 
analysis  which  isolates  the  product  that: 
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EXHIBIT  VI-1 


VENDOR  PROTOTYPING  PRODUCTS  CHECKLIST 


VENDOR  PROTOTYPING  PRODUCTS 

A 
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ETC. 

General  Support  Features 
Remote  Job  Entry 
Teleprocessing  Monitor 
PC /Mainframe  Link* 
Audit  (File  Footing,  etc.) 
Security  (Data/Resource)* 
Optimized  Compiler 
Linked  Application  Software 
High  Quality  Graphics 
OPS  System  Independent* 

Data  Management  Support  Features 

Relational  Data  Base* 
Data  Dictionary* 
Distributed  Data  Base  Support 
Data /Language  Independence* 

Program  Development  Features 

On-Line  Development* 
Batch  Development 
Interactive  Debugging 

^UUc   Vj  CMC  1  a  lIUi  1  /  rxcUoc 

Automatic  Documentation 
Query /Retrieval* 
Screen /Report  Writer* 
English  Language  Query 
Foreign  Language  Conversion 
Text  Editing/Formatting* 

*Represent  the  12  most  important  prototyping  features. 
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Meets  or  exceeds  the  organization's  planned  use. 


Is  favorably  rated  by  the  vendor's  customer  base. 

Is  technically  and  organizationally  compatible  with  the  organization's 
environment. 

Choosing  the  right  tool  is  a  function  of  what  it  will  be  used  for  and  then  how 
best  it  meets  the  requirements.  The  sample  of  vendor  products  reviewed 
differs  considerably  in  features  offered.  No  attempt  has  been  made  to 
qualitatively  judge  products  because  user  requirements  and  plans  must  be 
compared  to  tool  capabilities. 


a       CRITICAL  PROTOTYPING  SUCCESS  FACTORS 


Four  critical  success  factors  have  been  isolated  based  on  this  research.  These 
factors  apply  regardless  of  the  complexity  of  the  project  and  become  more 
important  with  the  spread  of  the  technique's  use.  The  critical  success  factors 
are: 

The  IS  organization  needs  to  plan  thoroughly,  allocate  resources,  and 
commit  to  the  use  of  prototyping  as  an  alternative  to  the  traditional 
life  cycle  development  process  as  a  way  of  improving  productivity  and 
reducing  the  applications  backlog. 

It  is  crucial  that  users  be  an  integral  part  of  the  prototyping  process. 
Their  responsibilities  should  include  review  and  approval  of  key 
deliverables.  They  should  be  co-equal  members  of  the  development 
team. 
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Prototyping  benefits  and  degree  of  success  should  be  measured  by  the 
reduction  of  project  time  required  to  deliver  a  user-approved  opera- 
tional system.  It  must  be  understood  that  it  is  a  cooperative 
learning/doing  process  for  both  the  user  and  developer. 

The  selection  and  use  of  an  efficient  DBMS-oriented  software  product 
or  suite  of  products  is  required  to  make  prototyping  practical. 

PROTOTYPING  STRENGTHS  AND  WEAKNESSES 

Prototyping  clearly  provides  a  significant  opportunity  to  accrue  improved 
applications  development  productivity.  Improvements  are  reported  to  range 
from  62-283%  over  3GLs  through  the  use  of  existing  4GL  products. 

This  research  has  documented  substantial  improvements  which  are  contrib- 
uting to  the  respondents'  ability  to: 

Chip  away  at  the  applications  backlog. 

Improve  user/IS  communications. 

Implement  successful  applications  to  meet  their  firms'  automation 
needs. 

Areas  of  specific  improvements  are  listed  in  Exhibit  VI-2.  These  strengths  are 
presented  in  average  rank  order  productivity  gains  that  respondents  reported. 

Client  percentage  improvements  will  obviously  differ,  but  these  values  can  be 
used  as  order  of  magnitude  standards  for  those  presently  using  or  just 
initiating  prototyping. 
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EXHIBIT  Vl-2 


SPECIFIC  PROTOTYPING  BENEFITS  REPORTED 
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Shorter  time  to  build  the  first  prototype. 

283% 

2 

Reduction  m  the  number  of  programming 
statements. 

260 

3 

Program  debugging  time  improvements 
related  to  performing  programming 
mechanics  such  as  compilations,  opens,  etc . 

214 

Better  reliability  and  readability  of 
application  code. 

148 

5 

Improvement  in  program  modifications  due 

134 

to  fewer  syntax  errors. 

6 

Training  time  it  took  to  be  productive. 

123 

7 

Design  improvement  due  to  automatic  code 
generation,  e.g.,  data  definitions,  screen 
formatting,  processing  logic,  etc. 

96 

8 

Production  systems  improvement  by  using 
automated  data  editing  features. 

76 

9 

Increased  ability  to  share  program 
modules  among  applications. 

62 
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For  those  who  have  not  yet  purchased  a  prototyping  tool,  this  research  has 
isolated  several  deficiencies.  In  deciding  on  a  vendor  product,  the  following 
weaknesses  should  be  considered: 

Existing  products  require  a  high  degree  of  technical  IS  knowledge  for 
efficient  use. 

The  next  generation  of  prototyping  products  (referred  to  as  5GL)  should 
be  based  on  an  expert  system  approach.  Readers  should  look  for  an 
existing  or  new  product  which  automates  as  many  routine  technical 
tasks  as  possible. 

Extensive  learning  curves  are  required  to  use  some  of  today's 
products.  Less  complicated,  easier  to  use  products  should  receive 
greater  consideration. 

A  major  capability  that  is  lacking  in  today's  products  is  the  automa- 
tion/integration of  the  applications  requirements  definition  specifica- 
tion. The  addition  of  this  feature  would  provide  a  major  productivity 
enhancement.  This  would  clearly  give  a  vendor  a  competitive  edge  and 
provide  an  additional  degree  of  freedom  for  detailed  design  tasks. 

In  summary,  INPUT  recommends  that  clients  use  this  research  as  a  benchmark 
for  successful  prototyping.  For  those  who  are  not  prototyping,  it  provides 
guidelines  for  success.  For  those  who  are  involved  in  prototyping,  the  quanti- 
tative results  and  approaches  can  be  used  to  compare  results. 
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APPENDIX  A:  DEFINITIOhJS 


A.       GENERAL  SUPPORT  FEATURES 


•  AUDiT  -  Provides  a  set  of  standard  routines  for  performing  auditing  tasks 
such  as  sampling,  file  footing,  etc. 

•  HIGH  QUALITY  GRAPHICS  -  Provides  the  ability  to  extract  data  from  a  data 
base  or  system  module  and  produces  a  variety  of  high  resolution  displays  on  a 
graphics  terminal  or  printer  in  black  and  white  or  color. 

•  LINKED  APPLICATION  SOFTWARE  -  Provides  users  with  business  application 
packages  that  are  compatible  with  a  host  data  base. 

•  OPERATING  SYSTEM  INDEPENDENCE  -  Provides  prototype  applications 
which  are  insulated  from  operating  system  version  changes. 

•  OPTIMIZED  COMPILER  -  Provides  a  facility  for  automatically  structuring 
code  that  minimizes  the  use  of  system  resources. 

•  PC/MAINFRAME  LINK  -  Provides  a  software  link  between  a  higher  order 
processor  and  a  personal  computer  to  download  data. 

•  REMOTE  JOB  ENTRY  -  Provides  access  to  popular  terminal  devices  through 
standard  interfaces. 
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•  SECURITY  -  Provides  a  working  set  of  data  and  resource  security  measures  to 
prevent  unwanted  access  and  alteration  or  removal  of  stored  data. 

•  TELEPROCESSING  MONITOR  -  Provides  mainframe  interface  with  major  TP 
monitors  for  distributed  processing. 

B.  DATA  MANAGEMENT  SUPPORT  FEATURES 

•  DATA  DICTIONARY  -  Provides  a  means  to  document  the  source  and  use  of  all 
data  used  within  an  application  or  system. 

•  DATA/LANGUAGE  INDEPENDENCE  -  Provides  a  controlled  correspondence 
between  the  logical  structure  and  physical  disposition  of  the  data  and  the 
application  (language). 

•  DISTRIBUTED  DATA  BASE  SUPPORT  -  Provides  an  operating  system  feature 
that  allows  distribution  of  data  and  application  models. 

•  RELATIONAL  DATA  BASE  STRUCTURE  -  Provides  for  unstructured  retrieval 
of  a  data  element  required  for  meeting  ad  hoc  or  unanticipated  use  of  stored 
data.  Offers  some  implementation  of  the  evolving  relational  data  base  model. 

C.  PROGRAM  DEVELOPMENT  FEATURES 

•  AUTOMATIC  DOCUMENTATION  -  Provides  the  ability  to  produce  source 
listings,  glossaries  of  definitions,  etc.,  whenever  the  application  design  is 
updated,  assuring  that  the  documentation  matches  the  current  application 
version. 
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BATCH  DEVELOPMENT  -  Provides  the  facility  of  processing  large  data 
intense  jobs  such  as  validating  transaction  files  or  updating  the  data  base. 


CODE  GENERATION/REUSE  -  Provides  the  facility  to  develop  program  code 
and  application  module  code  that  can  be  used  as  standard  routines. 

ENGLISH  LANGUAGE  QUERY  -  Provides  users  with  minimum  data  processing 
knowledge  to  access  system,  application,  or  data  base  information  by  using 
the  English  language. 

FOREIGN  APPLICATION  CONVERSION  -  Provides  a  software  tool  for 
converting  non-vendor  (foreign)  applications  to  the  DBMS  used  for  proto- 
typing. 

INTERACTIVE  DEBUGGING  -  Provides  program  design  capability  of 
correcting  code  errors  as  the  programs  are  being  built. 

ON-LINE  DEVELOPMENT  -  Provides  real-time,  interactive  development, 
execution,  and  verification. 

QUERY/RETRIEVAL  -  Provides  a  conversational  mode  for  use  during  proto- 
typing to  retrieve  information  from  the  data  base  or  system  files. 

SCREEN/REPORT  WRITER  -  Provides  the  capability  to  develop,  edit,  and 
format  CRT  screens  and  hard  copy  reports. 

TEXT  EDITING  AND  FORMATTING  -  Provides  an  integrated  system  facility 
for  text  editing  and  formatting  during  system  program  development. 
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APPENDIX  B 

USER  QUESTIONNAIRE 

APPLICATION  SIMULATION  AND  PROTOTYPE  TOOLS 

Good  morning   (afternoon).     This   is    calling  from  INPUT, 

an   international   research  and  planning  firm.     V/e  are  currently 
engaged   in  a  study  of  application  development  simulation  and 
prototyping  software  tools.     We  would  like  a  few  minutes  of  your 
time  to  gain  some  basic   information  about  your  experience  using 
this  approach  for  software  development.     The   information  you 
provide  will   be  held   in  complete  confidence  and  will   be  used  for 
statistical   purposes  only.     Your  identity  and  that  of  your  firm 
will   not  be  revealed.     In  appreciation  for  your  help  we  will  send 
you  a  summary  of  the  report. 

Maywe  begin?     Thank  you. 
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1.  First*   we  would   like  you  to   respond  to  the  generic 
definitional   elements  of  prototyping  by  rating  the 
following  attributes  using  a  scale  of  one  to  five  (1-5). 
On  this  scale  "one"   is  unimportant  while  "five"   is  a  very 
important  part  of  your  prototyping  effort.     How  would  you 
ratetheiniportanceof: 

Interactive  process  for  developing  a  final  applica- 
tion specification 

1   2  3   4   5       DK   MA_^   REF. 

2.  Reduced  time  between  iterations 


1   2  3   4  5       DK   NA_   REF. 


3.         User   involvement/approval    for  each  version 


1  2  3  4  5       DK   NA   REF. 


4.         Initial   prototype  produced  at  minimum  cost 


1  2  3   4  5       DK   IJA_   REF. 
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Integrated  hardware/software  support  tools 


1   2  3   4  5       DK   NA   REF. 


Are  there  any  attributes  which  we  have  not  covered? 


YES   no   DK   NA   REF 


IF  YES:   V/hat  rniaht  these  be? 


A.l   1   2  3   4  5  DK         NA  REF 


A.  2    1  2  3   4  5   DK         NA  REF 


ft 


.3   ^  1  2  3  4  5  DK         NA  REF 


V/e  would  like  to  establish  your  experience  level  regarding 
application  prototyping.  For  which  of  the  following  kinds 
of  projects  have  you  used  prototyping: 

Simple  Reports         YES   NO          DK          NA   REF  


Si.iall  Single 

Applications  YES   NO          DK          fiA   REF. 
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9.  LaPs^e  Single 

Applications  YES   NO          DK          KA   REF. 

10.  Smalllntegrated 

Applications  YES   NO          DK          NA   REF. 

11.  Ldrgelntegrated 

Applications  YES   NO          DK          NA   REF. 


12.  How  long  has  prototyping  been  a  formal   part  of  your 
application  d  evel  opinent  process? 

 ,   Years 

13.  Now  we  would  like  to  document  your  company's  MIS  budget* 
so  we  can  measure  the  impact  of  your  prototyping  effort. 
First*   what  is  the  total   MIS  budget   in  millions? 

1985  r.IS  budget   (Millions) 

14.  What  is  the  per  year  expected  growth  rate  for  the  next  3 
years?   per  year 
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V/hat  percent  of  your  1985   budget   is  for: 


Totalhardware   % 


Total   purchased  software    To 


Total    in- house  developed  software 


Total  communications  services   •   '    % 

Total   other   ( 100/^;  of  14)   % 

l.'hat  percentage  of  both  purchased  and   in-house  software 
(questions  17  and   18)   budget  applies  to  prototyping? 

rr 

  /o 


V/hat  percent  growth  rate  per  year  would  you  estimate  for 
all   prototyping  related  activities  for  the  next  3  years? 

c 

  /O 


Could  you   now  list  the  prototyping  tools  you   use?  providing 
a  vendor  citation  and   rating   for  each?     The  rating   is  on  a 
scale  of  1-5,   with   1  being   inadequate  for  prototyping  and  5 
being  adequate  for  prototyping. 
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TOOLS  VENDOR 


T  1 
1  1  • 

1 
1 

o 
Z 

•5 

4 

c 
-) 

u  r\ 

N  n  

D  C  C" 

Kt  r 

12. 

1 

2 

3 

4 

5 

DK___ 

NA  

REF 

T3  . 

1 

2 

3 

4 

5 

DK 

NA  

REF 

T4. 

1 

2 

3 

4 

5 

DK  

NA  

REF 

T5  .  _____ 

1 

2 

3 

4 

5 

DK 

NA 

REF 

23.       Are  there  any  comments  you  would   like  to  make  which  would 
explain  your  ratings? 

YES   NO   DK  NA   REF  


24         If  Yes,   what  might  these  be?     (INT.   note  tool   from  Q23 ) . 


25.       Now  we  would   like  to  discuss  the  f eat u  res   included   in  your 
support  tools  and  the  technical   knowledge  required  to  use 
these  features.     Please  rate  the   importance  of  the 
following  features  using  a   1-5  scale  where  1   is  unimportant 
and  5   is  a  very   important  prototyping  feature  tool.  Please 
also  rate  the  amount  of  technical    IS  knowledge  required, 
with  1  being  no  technical    IS  knowledge  and  5  being  advanced 
technical   IS  knowledge. 
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The  first  set  of  items  refers  to  General 
features.     Hov/   irn  port  ant  would  you  rate: 


Support 


FEATURE 


KNOWLEDGE 


26.       Remote  Job 
Entry? 


1  2  3  4  5 


DK   NA  REF 


1  2  3  4  5 

DK   MA  REF 


27.  Teleprocessing 
Monitor? 


1  2  3  4  5 


DK   \U\  REF 


1  2  3  4  5 
DK   NA  REF 


28.       PC  Tool  Linked 


to  Mainfrair.e? 


1  2  3   4  5 


DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 


29.       Audit,   e.g.*  confir- 
mation, file 
footing, 
sanipl  i  ng ,   etc  .  ? 


1  2  3  4  5 
DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 


30.       Security,   e.g.,  data 
and  resource? 


1  2  3   4  5 


DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 
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FEATURE 


KNOWLEDGE 


31.  Optimized 
Compiler? 


1  2  3  4  5 
DK  NA  REF 


1  2  3  4  5 
DK   NA  REF 


32.  Linked 

A  p  p  1  i  c  a  1 1  o  n 
Software? 


1  2  3  4  5 
DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 


33.  High-Quality 
Graphics? 


1  2  3  4  5 
DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 


34.       Operating  System 
I ndependence? 


1  2  3  4  5 
DK  NA  REF 


1  2  3  4  5 
DK   NA  REF 


Turning  to  the  area  of  Data  Management  Support  facilities 
how  wouldyou  rate: 


35.       Relational  DBMS? 


1  2  3  4  5 
DK   NA  REF 


1  2  3  4  5 
DK   NA  REF 


36.       Data  Dictionary? 


1  2  3  4  5 
DK   NA  REF 


1  2  3  4  5 
DK  NA  REF 
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FEATURE  KNOWLEDGE 

Distributed  DB 

Support?  12345  12345 

DK   NA  REF  DK   NA  REF 

Data  and 
Language 

Independence?  12345  12345 

DK   NA  REF  DK   NA  REF 

The  next  set  of  items  refer  to  Program  Development  Support 
features.     How  would  you  rate: 

On-line/Batch 

Development?-                                 12345  12345 

DK   NA  REF  DK   NA  REF 

Interactive 

Debugging?                                        12345  12345 

DK   NA  REF  DK  NA  REF 

Code  Generat  i  on 

and  Reuse?                                       12345  12345 

DK   NA  REF  DK  NA  REF 
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KHOV/LEDGE 


42.  Automatic 

Documentation?  12345  12345 

DK  NA  REF  DK  NA  REF 


43.  Query/Retrieval?  12345  12345 

DK   NA  REF  DK   IJA  REF 

44.  Sc re enand  Report 

Writer?  12345  12345 

DK   NA  REF  DK   NA  REF 

45.  English  Language 

Query?  12345  12345 

DK   NA  REF  DK   NA  REF 

46.  Foreign  Applica- 
tion Conversion?  12345  12345 

DK   NA  REF  DK   NA  REF 

47.  Text  Editing  and 

Formatting?  12345  12345 

DK   NA  REF  DK  NA  REF 
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48.       V/e  would  like  to  measure  the  benefits  accruing  from  your 

current  application  prototyping  activities.     Comparing  your 
current  prototyping  efforts  to  your  third  generation 
language   (3GL)   experience*   what  percentage   improvement  are 
you  experiencing   in  the  following  areas: 

Muiriber  of  training  hours  to  be  productive 


49.       Building  the  1st  prototype 
%    DK         NA  REF 


50.       Length  of  Design  Phase 


DK         NA  REF 


51.       Length  of  Development  Phase 


DK         NA  REF 


52.       Length  of  Implementation  Phase 


DK         NA  REF 
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Entire  life  cycle  effort  (Design  to  Implementation)  is 
shorter 


JO 


DK         NA  REF 


Ability  to  share  prografii  modules  aruong  applications 


7.    DK         fJA  PvEF 


Time  used  for  Automatic  Application  Code  Generation,  for 
Data  Definitions,   Screen  Formating  and  Processing  logic. 


DK         NA  REF 


Overall    reduction  of  the  Number  of  Programming  Statements 


DK         NA  REF 


Reduction  of  Program  modifications  due  to  syntax  errors 


Vo    DK         NA  REF 
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Reduction  of  programming 
opens/   etc.  that  results 


mechanics,  such  as  compilations, 
in   faster  debugging 


DK         NA  REF 


and   reliability  of  applications  code 


NA  REF 


60.       Automated  Data  Editing 


DK         NA  REF 


61.       Ease  of  Maintenance  Changes/Updates 


DK         NA  REF 


59.  Readability 


DK 
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62.       Given  your  prototyping  experience  and  the  benefits  you  have 
described*   what  are  your  thoughts  regarding  the  v/eaknesses 
of  the  current  prototyping  technology?     (INT.   Please  list 
and  rate  the  weaknesses  on  a  scale  of  one  to  five  with  one 
being  minor  and   five  being  major.) 


WEAKNESSES  APPROACH 

Wl.    1  2  3  4  5 

V/2.       ________________  1  2  3  4  5 

W3.       ______________  1  2  3  4  5 

W4.   1  2  3  4  5 


1  2  3  4  5 


experience*  will  your 


Y  =1       N  =2     DK   NA   REF 


63a.     Why  is  this? 


W5  . 


63.       Given  your  current  prototyping 
approach  change  in  the  future? 


-  76  - 

©1985  by  INPUT.  Reproduction  Prohibited.  INPUT 


64.       V.' i  1 1   there  be  increased  use   in  more  complicated  projects? 
Y  =1       N  =2  DK   NA   REF  


64a.     Why  is  this? 


65.       Would  new  application   areas  be  considered? 

Y   =1       N  =2  DK   NA   REF  


65a.     Why  is  this? 


66.       Are  there  any  other  plans  you   have  for  prototyping  that  we 
have  not  covered? 

YES   NO   DK   NA   REF_^  


66a.     If  yes,  what  are  they? 
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67.  Reflecting  on  our  conversation,  are  there  any  major  IS  or 
vendor  issues,  problems*  concerns,  that  you  would  like  to 
mention? 


YES   NO   DK   NA   REF 


67a.     If  Yes,   what  are  they? 


Thank  you. 
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About  INPUT 


INPUT  provides  planning  information,  analysis,  and 
recommendations  to  managers  and  executives  in  the 
information  processing  industries.  Through  market 
research,  technology  forecasting,  and  competitive 
analysis,  INPUT  supports  client  management  in 
making  informed  decisions.  Continuing  services  are 
provided  to  users  and  vendors  of  computers, 
communications,  and  office  products  and  services. 

The  company  carries  out  continuous  and  in-depth 
research.  Working  closely  with  clients  on  important 
issues,  INPUT'S  staff  members  analyze  and  inter- 
pret the  research  data,  then  develop  recommen- 
dations and  innovative  ideas  to  meet  clients'  needs. 


Clients  receive  reports,  presentations,  access  to  data 
on  which  analyses  are  based,  and  continuous 
consulting. 

Many  of  INPUT'S  professional  staff  members  have 
nearly  20  years'  experience  in  their  areas  of  speciali- 
zation. Most  have  held  senior  management  positions 
in  operations,  marketing,  or  planning.  This  exper- 
tise enables  INPUT  to  supply  practical  solutions 
to  complex  business  problems. 

Formed  in  1974,  INPUT  has  become  a  leading 
international  planning  services  firm.  Clients  include 
over  100  of  the  world's  largest  and  most  techni- 
cally advanced  companies. 


Offices 


NORTH  AMERICA 

EUROPE 

ASIA 

Headquarters 

United  Kingdom 

Japan 

1943  Landings  Drive 

INPUT 

CDS  Corporation 

Mountain  View,  CA  94043 

41  Dover  Street 

Dai-ni  Kuyo  BIdg. 

(415) 960-3990 

London  W1X  3RB 

5-10-2,  Minami-Aoyama 

Telex  171407 

England 

Minato-ku, 

01-493-9335 

Tokyo  107 

New  York 

Telex  27113 

Japan 

Parsippany  Place  Corp.  Center 

(03)  400-7090 

Suite  201 

Italy 

Telex  26487 

959  Route  46  East 

Nomos  Sistema  SRL 

Parsippany,  NJ  07054 

20127  Milano 

(201 ) 299-6999 

Via  Soperga  36 

Telex  134630 

Italy 

Milan  284-2850 

Washington,  D.C. 

Telex  321137 

11820  Parklawn  Drive 

Suite  201 

Sweden 

Rockville,  MD  20852 

Athena  Konsult  AB 

(301)  231-7350 

Box  22232 

S-1 04  22  Stockholm 

Sweden 

08-542025 

Telex  17041 
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